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Abstract — Posterior matching is a method proposed by Ofer 
Shayevitz and Meir Feder to design optimal coding schemes for 
general point-to-point memoryless channels with feedback. In 
this paper, we present a way to extend posterior matching based 
encoding and variable rate decoding ideas for Gaussian MAC 
channel with feedback, referred to as time-varying posterior 
matching scheme, analyze the achievable rate region and error 
probabilities of the extended encoding-decoding scheme. The 
time-varying posterior matching scheme is a generalization of 
the Shayevitz and Feder's posterior matching scheme when 
the posterior distributions of the input messages given output 
are not fixed over transmission time slots. It turns out that 
the well-known Ozarow's encoding scheme, which obtains the 
capacity of two-user Gaussian channel, is a special case of 
our extended posterior matching framework as the Schalkwijk- 
Kailath's scheme is a special case of the point-to-point posterior 
matching mentioned above. Furthermore, our designed poste- 
rior matching also obtains the linear-feedback sum-capacity for 
the symmetric multiuser Gaussian MAC channel. Besides, the 
encoding scheme in this paper is designed for the real Gaussian 
MAC channel to obtain that performance, which is different 
from previous approaches where encoding schemes are designed 
for the complex Gaussian MAC channel. More importantly, 
this paper shows potential of posterior matching in designing 
optimal coding schemes for multiuser channels with feedback. 

Index Terms — Gaussian Multiple Access Channel, Feedback, 
Posterior Matching. 



I. Introduction 

In the early work [9], Shannon proved that feedback could 
not increase the capacity of point-to-point memoryless chan- 
nel. However, feedback can improve error performance and 
simplify the transmission scheme for this kind of channel. 
In [10], Hostein proposed a simple sequential transmission 
scheme, which achieves the capacity of Binary Symmetric 
Channel (BSC) and provides large error exponents than 
traditional fixed length block coding. Besides, Schalkwijk 
and Kailath also showed that feedback could improve error 
performance and/or simplify the transmission scheme for 
point-to-point Gaussian channel [7], [8]. For the Gaussian 
multiuser channels, the situation is more interesting. In 
[12], Gaarder and Wolf proved that feedback could enlarge 
the capacity region of the multiple access channel (MAC). 
Ozarow [3] successfully constructed a simple coding scheme 
for the two user Gaussian MAC channel with feedback and 
reaffirmed that feedback could increase the capacity of the 
channel. Furthermore, Kramer devised a code for the complex 



Gaussian MAC channel based on a beautiful property of the 
circulant matrix that has all the columns of the DFT (Discrete 
Fourier Transform) matrix as its eigenvectors [14]. This 
code was proved to obtain the linear-feedback sum-capacity 
of the symmetric Gaussian MAC channel with feedback 
[16]. Besides, by using the control-theoretic approach to 
communications with feedback, Ehsan Ardestanizadeh and 
Massimo Fraceschetii [17] also proposed a linear code which 
has the same performance as Kramer's code for symmetric 
complex Gaussian MAC channel. However, as we mentioned, 
both these codes were designed for the complex Gaussian 
MAC channel and don't work for the real Gaussian MAC 
channel. 

Recently, Ofer Shayevitz and Meir Feder [1], [2], and [4] 
have discovered an underlying principle between the Hostein 
and Schalkwijk-Kailth schemes in a simple encoding scheme 
called posterior matching scheme for general point-to-point 
memoryless channels. The ideas of posterior matching is 
that the transmitter encapsulates the information that receiver 
does not know up to present time in one random variable 
and then transmit that random variable to the receiver in 
the next transmission to refine the receiver's knowledge. 
The distribution of that variable will be selected in a way 
such that the input constraint is satisfied. Later, J.H.Bae and 
A.Anastasopolous extended this scheme for the finite-state 
channel with feedback by using another approach [11]. One 
interesting open problem is to extend the Ofer Shayevitz and 
Meir Feder posterior matching scheme for multiuser cases. 
In this paper, using the same approach as Ofer Shayevitz and 
Meir Feder used for point-to-point memoryless channels, we 
propose a posterior matching based encoding and decoding 
strategy for the real Gaussian MAC channel, referred to as 
a time-varying posterior matching scheme, analyze the error 
probabilities for all encoding-decoding schemes designed by 
using these strategies. 

We analyze the achievable rate region and error per- 
formance of encoding and decoding schemes using these 
strategies by defining a generalized iterated function systems 
(GIFS) which has the generalized average contractive prop- 
erty (average contractive in the limit). Refer our Theorem 
I for more details. Note that our imposed constraint is less 
strict than the constraint that Ofer Shayevitz and Meir Feder 
imposed to analyze the point-to-point memoryless channels. 
Specifically, in Theorem 6 in [4], Ofer Shayevitz and Meir 
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Feder used the relations between the information rates and 
contraction properties of the iterated function systems (IFS) 
to analyze the error probability for point-to-point cases. For 
the continuous cases, they assumed that the reverse iterated 
function system (RTFS), generated by the kernel w y (-) := 
F~^ Y o Fx and controlled by the identically distributed 
output sequence {Yk}^-i, has the average contractive prop- 
erty to analyze the error performance of their posterior 
matching schemes. That assumption requires the distribution 
at the output of the point-to-point memoryless channel be 
identically distributed when using their proposed encoding 
schemes. This also means that if the output distribution is 
not identically distributed, the error analysis in Theorem 6 
in [4] cannot apply. For example, this situation happens with 
our proposed matching schemes for MAC channels in this 
paper. 

Finally, we illustrate our strategies by designing an en- 
coding scheme that obtains optimal performances for the 
real Gaussian MAC channel. Specifically, our proposed code 
obtains the same performance as the Ozarow's code [3] for 
the general two-user Gaussian channel, so it achieves the 
capacity of this channel. For the case when the number of 
users is greater than 3, our proposed code obtains the same 
performance as the Kramer's code in the sense of sum-rate, 
so it is optimal among linear codes with respect to sum rate 
capacity. To the best of our knowledge, the time-varying 
posterior matching scheme in this paper is the first code 
designed for the real symmetric Gaussian MAC channel to 
achieve the linear-feedback sum-capacity when the number 
of users is greater than 3. 

II. Channel Model and Preliminaries 
A. Mathematical notations 

Upper-case letters, their realizations by corresponding 
lower-case letters, denotes random variables. A real-valued 
random variable X is associated with a distribution Px(') 
defined on the usual Borel a-algebra over R, and we write 
X ~ Fx- The cumulative distribution function (c.d.f.) of X 
is given by Fx{x) = Px((— oo, x]), and their inverse c.d.f is 
defined to be F^ (t) := \nf{x : Fx{x) > t}. The uniform 
probability distribution over (0, 1) is denoted through U. The 
composition function (/ og)(x) = f(g(x)). In this paper, we 
use the following lemma: 

Lemma I: Let X be a continuous random variable with 
X ~ Px and 9 be an uniform distribution random variable, 
i.e. ~ U be statistical independent. Then F^ 1 {Q) ~ 
and F X {X) ~ U. 

Proof: Refer [4] for the proof. ■ 



B. Gaussian Multiple Access Channel with Feedback 

Consider the communication problem between M senders 
and a receiver over a multiple access channel with additive 
Gaussian noise (AWGN-MAC) when channel outputs are 
noiselessly fed back to all the senders (Figure 1). Each sender 
m £ {1,2, ...,M} wishes to reliably transmit a message 
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Fig. 1 . M-user Gaussian MAC Channel with Feedback 



m G M m in the unit interval, i.e., M m := (0, 1) to the 
receiver. At each time n, the output of the channel is 



Y„ 



M 



where X„ ' G R is the transmitted symbol by sender m at 
time n, Y n £ R is the output of the channel, and {Z n } is a 
discrete-time zero mean white Gaussian noise process with 
unit average power, i.e., E[Z%\ = 1 and is independent of 
0i, 02, ©m- We assume that output symbols are casually 
fed back to the sender and the transmitted symbol Xn 
for sender m at time n can depend on both the message 
m and the previous channel output sequence K n_1 := 
{Yi, Y2, ■ Y n -i}. 

A transmission scheme for a Gaussian MAC channel is a 
set of M sequence of transmission functions ' : (0,1) x 
y n , m = {1,2,3, M}, so that the input to the channel 
generated by the transmitter is given by 

A decoding rule for a MAC channel is a sequence of 
measurable mappings {A„ : y n ->^xf 2 x ... x £m}^Li, 
where {£ m }*f =1 are the sets of all open intervals in (0,1). 
The mth component of this decoded vector, denoted as 
An (y n ), refers as the decoded interval for the user m. The 
error probabilities at time n associated with a transmission 
scheme and a decoding rule, is defined as 

ptHe) := P (© m i Al" l )(y")) ,Vm £ {1,2, ...,M] 

and the corresponding achievable rate vector at time n is 
defined to be 



(i?W,i?l 2 ),...,i?l^) : i?M = -ilog|AW(y») 



We say that a transmission scheme together with a de- 
coding rule achieve a rate vector (Ri, R2, Rm) over a 
Gaussian MAC channel if for all m £ {1, 2, M} we have 



lim I 

n— f 00 



(Ri m ^ < R m ) - 0, lim p^\e) = (1) 
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The rate vector is achieved within input power constraints 



{Pm]m=i' if in addit i° n 

n 

lim - Y E(xi m) ) 2 < P m , Vm (2) 

k=l 

An optimal fixed rate decoding rule for a MAC channel 
with rate region i? 2 , Rm) is one that decodes a 
vector of fixed length intervals {( Ji, J 2 , Jm) '■ \J m \ = 
2 _nflm ,Vm}, whose marginal posteriori probabilities are 
maximal, i.e., 

A ( n m \y n ) = a rgmax Jme£:|Jm|=2 _ nflm Pe m |rn(J m |2/") 

An optimal variable rate decoding rule with target error 
probabilities pi" 1 ^ (n) = 5^ is one that decodes a vector of 
minimal-length intervals ( J\, J 2 , Jm) with accumulated 
marginal posteriori probabilities exceeds corresponding tar- 
gets, i.e., 



AM(y")=argmin Jrr 



(Try 



,e£ : Pe m |yn(^m|l/ n )>l-^ 
Both decoding rules make use of the marginal posterior 
distribution of the message point Pe m |y™ which can 
calculate online at the transmitter m and the receiver. Refer 
[4] for more details. A proof that the achievability in the 
sense of (1) and (2) implies that the achievability in the 
standard framework are in the Appendix. 

Lemma II: The achievability in the definition (1) and (2) 
implies the achievability in the standard framework. 

Proof: Refer to the Appendix. ■ 

III. Time-varying Posterior Matching Scheme 

A. Shayevitz and Feder's Posterior Matching Scheme 

In this part, we firstly review the posterior matching 
scheme proposed by Ofer Shayevitz and Meir Feder for 
point-to-point channel in [4]. Specifically, the authors 
argued that after the receiver observed the output sequence 
Y n , there is still some "missing information" that can be 
encapsulated in a random variable U with the following 
properties: 

(i) U is statistically independent of Y n . 

(ii) The message point 80 can be a.s. uniquely recovered 
from {U,Y n ). 

With that line of thought, they proposed a principle for 
generating the next channel input as follow: 

The transmission function g n +i should be selected 
so that X n+ i is Vx -distributed, and is a fixed function 
of some random variable U satisfying properties (i) and (ii). 

Lemma III: (Posterior Matching Scheme [4]). The fol- 
lowing transmission scheme satisfies the posterior matching 
principle for any n: 

9n+1 (6,y n ) = F^ 1 o F eolYn) (6\y n ) 



Based on the transmission functions, the input to the channel 
is a sequence of random variables given by 



X n+1 =F x 1 oF eolYn (Qo\Y n ) 
Proof: Refer [4] for the proof. 



(3) 



B. Time-varying Posterior Matching Scheme 

In this section, we propose a posterior matching scheme 
for additive Gaussian multiple access channel (MAC) with 
feedback, called time-varying posterior matching. Our 
encoding proposal is based on the two following lemmas: 

Lemma IV: For an additive white Gaussian MAC channel 
with feedback having M inputs and one output, where the 
output signal to be a linear combination with known coeffi- 
cients of the input signals, i.e. Y n = X)m=i ai"''li m ' + Z n 
where Z n is the additive white Gaussian noise. Under the 
condition that the correlation matrix among transmitted sym- 
bols at each time slot n defined as 



R„ 



E[X^X^\ 



E[X. 
E[X. 



(1) y(M)i 
n An J 

(2) v (M)i 



E[X. 



(M) x (l), 



E[X, 



(M) X (M), 



(4) 



is a fixed function of n. Then the posterior matching scheme 
in Lemma III at each transmitter m becomes a time-varying 
posterior matching which is given by 

Xi m) - F x l (0 m ) ; X%{ = F x loF x ^ Yn (x^\Y n ) 

where the random variable X m encapsulates the input power 
constraint, and 6 m is the intended transmitted message at 
the transmitter m. 
Proof: 

F emlY 4e\y n ) = v(e m <e m \Y n = y n ) 
= ng^K^y 71 - 1 ) < girHo^y"- 1 )^ = y n ) 

= nxW<g$r\6 m ,y n - 1 )\Y n =y n ) 

^F(XW<g(r\6 m ,y n - 1 )\Y n = y n ) 
= F x ^ ) ^{g^\e mi y n - 1 )\y n ) 
Then we have 

X { ™\=F x loF Qm \ Yn {Q m \Y n ) 
= F x 1 m oF xkm)]Yn (g( i r\e m ,Y n - 1 )\Y n ) 
= F xl°F x ^ Yn {X^\Y n ) 

where (a) follows the fact that the transmission function 
is continuous and monotone, and (b) follows that Y n is a 
linear combination with known coefficients of inputs X^\ 
therefore the posterior distributions of X^\Y n are only 
dependent on the correlations among transmitted symbols at 
time n. Since we assume that the correlation matrix R„ is a 



4 



fixed function of n, hence the distributions of X n m ^\Y n are 
fixed function of n. In other words, given Y n , each Xn^ is 
independent of V 1 ^ 1 . 



Besides, from the Lemma I, 



F X^\Y r 



(X n m) \Y n ) 



U, hence X, 



(m) 
n+l 



we 

Xm. 



know that 



We refer the transmission scheme in (4) to as time-varying 
posterior matching scheme and prove an interesting converse 
result of the Lemma IV. 

Lemma V: For an additive white Gaussian MAC channel 
with feedback having M inputs and one output, where the 
received signal to be a linear combination with known coeffi- 
cients of the input signals, i.e. Y n = J2m=i "ii"'^" 1 ' + Z n 
where Z n is the additive white Gaussian noise. Assuming 
that at each transmitter, a time-varying posterior matching 
encoder is deployed, so the recursive transmitted sequence at 
the transmitter m is given by 



x{ m) =F x Ue m ); X, 



(m) 
n+l 



F X m ° F xk m) \Y r , 



where m is the intended transmitted message. Then the 
correlation matrix among transmitted symbols at each time 
slot n defined as in the Lemma IV can be calculated online 
at the transmitters and the receiver, and more importantly the 
posterior distribution {X^\Y n } can be calculated online at 
both the transmitter m and the receiver. 

Proof: Observe that Y n is a linear combination of 



X^\z n , m = 1,2, 3..., M. Moreover, with time-varying 
posterior matching transmission applied for Gaussian MAC, 
X^\ is a linear combination of X n "^ , Y n (as we will see in 
the proof of the Theorem II below), so X^™\ is a linear 
combination of X n m \z n , m e {1,2, ...M}. Therefore, 

(m) (k) 

the correlation between X n+ [ and X^+i only depends on 
the correlations among transmitted symbols at time n, i.e. 
X n m \ m e {1, 2, ...,M}. In other words, R„+i is afunction 
of R„, so the transmitters and receiver can be calculated the 
matrix R„ online at both transmitters and receiver. Moreover, 
from the relation Y n — J2m=i otn^X^ + Z n , we see that 
the distribution of X n m ^\Y n is a function of all elements in 
the correlation matrix R n . That concludes the proof. ■ 



For a continuous point-to-point memoryless channel, the 
distribution X n \Y n doesn't depend on n, hence we have the 
posterior matching scheme for this case like the formula 
(16) in [4]. However, in a MAC channel (for example 
additive white Gaussian MAC channel), where each received 
signal is a linear combination of all transmitted signals and 
Gaussian noise, the distribution X n m ^\Y n between the input 
m and the output may be dependent on n. Therefore, time- 
varying posterior matching scheme may be the solution to 
overcome this problem. However, we will see from our proof 
in the Theorem I below the variable rate decoding rule, 
or Generalized Reverse Iterated Function System (GRIFS), 
can be applied at receiver to decode signals if and only if 
all the distributions X n m ^\Y n can be calculated online at 
the corresponding transmitters and receiver. With the result 



in the Lemma V, this condition is always satisfied when 
time-varying posterior matching encoding schemes used at 
transmitters. We will show in the next parts that using time- 
varying posterior matching scheme at transmitters can obtain 
optimal performances for some known cases. 

IV. Error analysis for time- varying posterior 

MATCHING SCHEME 

In this section, we analyze error performance for Gaussian 
MAC channel with feedback deployed the time-varying 
posterior matching scheme at the transmitters and variable- 
decoding rule at the receiver. 

Theorem I: Consider a real Gaussian MAC channel 
with M transmitters and one receiver without input power 
constraints. Assuming that at each transmitter m, transmitted 
sequence X n m ^ conforms the time-varying posterior match- 
ing rule, as following: 



X [ m) = F x l (6 r , 



<;X. 



(m) 



Fx ° 



x; '|y„ 

where X m ~ N(0,P m ) is a Gaussian random variable, 
and Y n is the output of the Gaussian MAC channel which 
is a linear combination of all these transmitted signals at 



time n. Let w 



L,, t (h) 



\h(s) 



:= F~ 



x" 



h(t)\ 



>\Y, 



(■\Y n ) o Fx m , Vn e N and 



\8-t\ 

Under the conditions that 



as the global Lipschitz operator. 



< limsup (sup s#t E [z, S;t (w^)]) < 1 (5) 



Rni 



(OJ) 



define: R* m := - limsup^^ log (sup s#t S 

Then the rate region {(Ri, Ri, Rm) '■ 
is achievable by setting the target error probabilities 
Pn^ (e) -4- under the constraint 

Pl m) (e) 



^ 2 2n(R* m -R m )^ ^ Vme {1,2,...,M} 



I -In 



Proof: First, observe that since the distributions 
i n ,n — 1,2,... can be calculated online at both 
transmitters and receiver by Lemma V, therefore can 
be calculated online at both the transmitters and receiver. 



Denote T„ m) (s) : 



(m) (m) 

Wy ° Wy ■ 



o iBy m '(s), Vs e 



referred as to a Generalized Iterated Function System 
(GIFS) generated by the kernel sequence {w y ™' l }^L 1 . 
For each m e {1,2, ...,M}, select a fixed interval 
j(m) _ ( Sm c M as the decoded interval with respect 



to X, 



(m) 
n+l- 



Define the corresponding interval at the origin to be 
J„ m ^ := (T n (s m ),T n (t m )) and set them to be the decoded 
interval for x[ m ^ = F Xm (© TO ). and so the decoded interval 



for 9 m are set to be Al m) (Y n ) = F x J J r \ m> ). Let 



From the condition (5) in the theorem, we know that 

r m :— limsupr^ < 1 



(6) 



(7) 
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Observe that: 

P (R^ < Rrn) ■■ 

<p(l4' 

where K m = swp xeR {f Xm (x)} 



(8) 



< 1, then 



On the other hand, since r m = lim sup n 
for any arbitrarily small e > 0, there exists an N e S N such 
that rf < r m + e, Vn > iV e . Let t m := sup^^ r„ . 
For any fixed number R m , from (8) we have: 



< K m 2 nRm E 



(b) 



(i#"> <R m )<V (|4 m) | > 2- nR -/K m ) 

S (Ki OW Y 2 - OW Y n ( S m) 

<K m 2 nR ~t m E(\w { ^...ow^\ Sm ) 
-w^\..o W ^\t m )\) 

-4:;...o4:) ( t m) |) 

... ( <V m 2«^(t m )^(r m + £ )("-^)|J 1 ^| 



(9) 



for any e arbitrarily small, where (a) follows the Markov's 
inequality, (6) follows t, m := sup 1<fc<JV r„ , and (c) is a 
recursive application of the preceding transitions, (d) follows 
fm' < r m + e, Vn > N e above and recursive applications 
of the preceding transitions. 

From (9), it is easy to see that a sufficient condition 
for P(#i m) < i? m ) ^ is given by choosing \j[ m) \ = 
Q ^^s^+er'-R^y observe that e can be made arbi- 
trarily small, therefore, the rate region {(Ri, R 2 , Rm) '■ 
R m < log (r" 1 ), Vm G {1,2,..., M}} is achievable, where 



lim sup log sup E 



L 



S.I 



Since P ^i?!™' 1 < i? m ^ — > depends only on the length 

of j[ m \ so we can choose s m — —t m . Furthermore, from 
the Lemma I, we are easy to come to conclusion that 
xffi ~ A/"(0, P m ). Using the standard bounds for Gaussian 
distribution we obtain 

pM( e ) = p (e m i F Xm = p i A m) ) 

= 1 -P Xm (J 1 M ) = o (tfn{R' m -R m )^ 



V. A Posterior Matching Scheme for Gaussian 
MAC Channel with Feedback 

In this section, we consider a real Gaussian MAC channel 
with M receivers and input power constraints Pi, P 2 , ...,Pm 
at the transmitters 1,2, ...,M, respectively as defined in 
the section II. Our encoding scheme for this channel as 
following: 

Encoding: 

• At the time interval n, each transmitter m <E 
{1,2,..., M} creates a random variable X^ following 
the posterior matching rule: 

4 m) = F x l(Q m ); X%\ = F x l o F x ^ Yn (x™\Y n ) 

where X m ~ N(0, P m ) is a Gaussian random variable, and 
Y n is the output of the MAC channel. 

* After that, the transmitter m sends the signal a^X^ , 
where a n = [ a„\ } T is the column 
(n mod M) + 1 of the Hadamard matrix (M by M), which 
is a spreading code for CDMA systems. 

We refer this encoding strategy as Gaussian MAC 
channel's posterior matching feedback coding and decoding 
strategy. 

Theorem II: Using the Gaussian MAC channel's posterior 
matching feedback coding and decoding strategy above, the 
rate region {(Ri, R 2 , ...,Rm) ■ R m < R* m } is achievable for 
Gaussian MAC channel with feedback, where 

R* m = -\ lim sup (log L^A 

by setting the target error probabilities 

-logp^e) = o (2 2n(R ™- R ™^ , Vm 



where 

L {m) = 1 - 



V^M (t) (t,m) 
Et=l a "/°n WPt 



rvV> n V> n V> l > / P P 4-1 



(t)^,(0 „W) 



Proof: Applying the Lemma I, we see that for any m e 
{1,2, ...,M} then: 



X^ ~Af{0,P m ), VneN 



(10) 



Observe that, by this transmission strategy, each transmit- 
ter m, m e {1,2, M} transmits an X^ at time n 
with |al m ^| = 1, thus the input power constraints at all 
transmitters are always satisfied at each transmission time 
n, n = 1,2... Moreover, the output at receiver at time n will 
be 

Y n = aipX^ + al?X^ + .... + c^X™ + Z n 
Thus 

M 

cov(X^\Y n ) = Y,a®p£ m) y/tt> 



t=i 
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M M 



var(y„) = ]T £ a«a« v^/^ + 1 



4=1 z=i 



Finally, we have: 

E[X^\Y n ] 
and 

var(x( m )|F„) 
Therefore, 



Yn 



— P — - 



"m I 2^4=1 a n Pn V " t I 



EM v-^M (4) (0 ; D D (.1,1,1 , i 
4=1 Li=l «n Q!n WPtPlPn + 1 



(4,0 



(^ m) |^n) 



v( m ) _ ,l( m )y 
^ n -^-n J n 



R ( m ) 
-£>n 



(ID 



where 



V27T J-co 



Moreover, from (10) we have: 

x( m >~AA(0,P m ) 

thus, 



n 

and 

r("») — p 



(12) 



(13) 



From (10) and (11) we obtain: 

F xi°F x ^ lYn (x^\Y n ) = ^/P„ 

Hence, 



^-n J*-n 1 r 



n *n 

) 



p 



Finally, we have: 
limsup (sup s ^ t E L Syt (wy^\sU J = limsup ' 

ApM (4) (4,m) /p-\ 2 



l B { n m) 



lim sup 



V M V M At) (I) (t,l) /ppr , , 



1/2 



If we can achieve 



^4=1 a « Pn V-nt 



< lim inf - , 

2^4=1 1^,1=1 a n 0> n Pn \ r t fl + 1 



< 1 



then 

< limsup 



< l 



This means that the condition in the Theorem I is satisfied, 
which leads to the rate region {(Ri, R 2 , Rm) ■ R m < 
R* m } is achievable, where 

R* m = - lim sup log (E \L e , t (w™)]) 



= — lim sup - log 

n — ^00 ^ 



' R ( m ) ' 



= -^limsup (log 4™)) 



Note that this capacity region is obtained by setting the 
target error probabilities p„ (e) — > under the constraints 

-logp^(e) =o(2 2 "(- R -- R -)) , Vroe{l,2,...,M} 

which have the well-known double-exponential behavior. ■ 

In the following, we will specify achievable rate regions, 
and error probabilities for two cases: the general two-user 
Gaussian MAC channel, and the real symmetric Gaussian 
MAC channel when the number of users is arbitrary. 

From the Theorem II, we see that the strategy to design 
posterior encoding scheme for multiple access channels with 



feedback is to find the sequences a n such that 

, 2 



< lim inf - 

n— too 



M (4) (4,m) 



2^4=1 Q n Pn 



for all m = 1,2, ...,M. 



<1 (14) 



Case 1: Two-user Gaussian MAC channel with feedback. 
To show that Ozarow's coding scheme [3] is a special 
case of our posterior matching framework, we can set 
dn^ = l,o4 2) = sgn(p„) and later prove that sgn(/9 n+ i) = 
— sgn(p„). Observe that the constraint (14) can be also 
checked to be satisfied by this setting since 

lJ PiPn + VKsgn(p n )} 2 



< LV ±r " v — < 1 

P 1 +P 2 + 2\ Pn \y/P[P 2 + l 



for m = 1 and 

< 

for m = 2. 



r Pl+^P2\Pn 



P l +P 2 +2\p n \^T\P~2 + l 



< 1 



Now we need to find the recursion of X n ^ and X n 2 ^ in 



this case. Observe that the output sequence: 

Y n = X { ^ + X%hgn{p n ) + 

where Z n is noise process and Z n ~ A/"(0, 1). 
From (12), (13) we have 

VPi(VPi + \Pn\y/P2) 



(15) 



P 1 +P 2 + 2\ Pn \^T\P 2 + l 
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A (2) = V^(V^ + v/Pr|Pn|)sgn(/r> n ) 
" Pl+P2 + 2|p„|^/F^+l 



and 



= Pi 



P 2 (l-p2) + l 



Pi + P 2 + 2|p n | x /PiT 2 ~ + l 



'P 1 +P 2 + 2\p n \s/I\P 2 + l 



Therefore, we obtain: 

A n+1 - 



(1) _ Pl+P2 + l+1\ Pn \y/T\P2 
V P 2 (l-p2 ) + 1 



X (l) _ Pi + y 

" Pl+P2 + l + 2|p„|^/F^ * 



and 



, x v (2) Pl+P2 + l + 2\Pn\VWP2 

y(2) ^2 + |Pn|7PT7¥ v \ , , 



^[ A n+l A n+lJ 



v /var(X« 1 )var(4 2 +1 ) 
p»-sgn(p Tt )VPiP 2 (l-p 2 ) 



(16) 



Finally, the time-varying posterior matching encoding 
scheme for Gaussian MAC channel with feedback in this 
special case as following: 

. Step 1: 

p 1 -p[F Xi 1 (e 1 )p X2 1 (e 2 )] = o 

Transmitter 1 sends: 

Transmitter 2 sends: 

X[ 2) =F£{Q 2 ) 

• Step n + 1, n > 1, 

Both transmitters estimate: 



Pn - Sgn(p„)VPlP2(l - /4) 



V[P2(1-P£) + 11^(1 -p2) + l] 

Transmitter 1 sends: 



(i) / p 1 + p 2 + i + 2| Pra | A /7yp 
" +1 V p 2 (i-^) + i 

X d) Pi + \pn\VF1P2 



P X + P 2 + 1 + 2\ Pn \sfT\P 2 



Yr. 



(2) . |Pl+P2 + l+2\Pn\^/^^P~2 



Transmitter 2 sends: 

sgn(p n+ i)X^ 1 = 

,(2) _ P 2 + |Pn|7P^ 



x X. 



P 1 + P 2 + l + 2\ Pn \V7\P 2 - 
Achievable rate region and error analysis 

For this special case, we have 

L (i) = P 2 (l-/^) + l 

and 



Pi(l-P^) + 1 

y„ I sgn(p„ + i) 



P 1 +P 2 + l + 2\p n \JI\P 2 



Ll 2 



Pi(l-P^) + 1 



(17) 



(18) 



P 1 +P 2 + 1 + 2| P „| % /PP^ 

Apply the Theorem II above, we obtain the achievable 
rate region for Gaussian MAC channel with two users as 
{(Pi,P 2 ) : Pi < R\,R 2 < R* 2 } where 

l r . ^ Pi+P 2 + l + 2|p»|v/p7P^ 
Pi = - hm inf log — -j— — (19) 

2 V ^2(1 - Pn) + 1 / 

Similarly, 



r* 1 1- • f 1 ^ Pi+P2 + l + 2|p»|7PTP^ \ 

P 2 = - hm mf log — 2 - (20) 

2 V ^H 1 - Pi) + 1 / 

by setting the target error probability to 

-logpW( e ) = o(2 2 "W-^)) 

and 

-logp( 2 )( e ) = o(2 2 "(«)) 

Much like Ozarow in [3], at the reception 1, the receiver 
adds an independent random variable W <~ A/"(0, cr^) before 
feeding back the first receiver signal to the transmitters 1 and 
2 to set \p 2 \ = p*, where p* is the biggest solution in (0, 1) 
of the following equation: 



p + 



= 



(21) 



v /[P 2 (1-P 2 ) + 1][Pi(1-P 2 ) + 1] 

By this changing, from (16) we see that p n = (— l) n+1 p*, 
so sgn(p„ + i) = — sgn(/9„) as mentioned above. We also have 
lira inf n^co \p n \ = p* , where p* is a positive solution of the 
equation (21). Replace this result to (19), (20) and combine 
with (21), we have: 

^ = ^log [l + Pi(l-(p*) 2 )] 

^2 = 7^0g [l + P 2 (l-(p*) 2 )] 



R\ + R*2 = \ log (l + Pi + P 2 + 2p*^P 2 

where p* is defined above. We see that, all the results 
are the same as Ozarow's results in [3]. So our posterior 
matching encoding scheme is optimal for Gaussian channel 
MAC with two users. 
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Case 2: M-user symmetric Gaussian MAC channel 
with feedback. We consider symmetric case, where 
Pi=P 2 = ... = Pm = P- 

Achievable rate region and error analysis: 

Assuming that all the transmitted messages are statistically 
independent. We will prove by induction that the normalized 
covariance R„ ~ -pE [X„X^] have all the columns of the 
Hadamard matrix (M by M) as its eigenvectors and that R„ 
are symmetric positive definite for all n = 1, 2, 3, ... 

Indeed, with the assumption all the transmitted information 
messages are statistically independent, we will have Ri = 
1m, which is an identity matrix of size M. Therefore, it is 
obvious that all the columns of the Hadamard matrix (M by 
M) are eigenvectors of the matrix Ri and that Ri = 1m is 
a positive definite matrix. 

Now, assume that R„ has all columns of the Hadamard 
matrix (M by M) as its eigenvectors and that R„ is positive 
definite for some n > 1. Since we assumed that R„ is 
symmetric positive definite matrix, all its eigenvalues are 
greater than 0. Denote h 1; h 2 , are M columns of the 
Hadamard matrix H. By this encoding scheme, we set the 
vector a n — h/ n mod m)+i- Assume that X n is the eigenvalue 
of R„ associated with this eigenvector. We have 



|an|| 2 A r , 



MX r 



On the other hand, we also have 



M 



(22) 



(23) 



t=i 



where p^ 1 is the mth column of the matrix R„. Note that 
R^ = R„, this means that 

R n Oi n X n ca n 

Hence, 

a T n p^=\ n a^\ Vme{l,2,..,M}. (24) 
Substitute (24) into (23) we obtain: 

M 

E a (t) (t,m) _ \ (m) 

t=l 

From (12), (13), (22), and (23), we obtain: 

P\l 



B (m) = p 



1 - 



and 



MPX n + 1 



Aim) _ P\ n a n 

MPX n + l 



for all me {1, 2, M}. 

Observe that from the proof of the Theorem II above, then 



A n+1 



X 



(m) 



Jin 1 n 



R ( m ) 
tin 



, Vm G {1,2,...,M}. 



Define the correlation coefficient between X„ m ^ and X n k ^ 



Jm,k) 



E[X n m) X n k) ] 



(fe) 



Then, we have 



V /var(xi m) var(^ i 



{m , k )_P Pn m ' k) -A^A^E[Y^} 

Pn+1 — 



^B n m) B n k) 



By replacing all values of , B n m ^ calculated above, we 



obtain 



Am,k) 1 + MPXn j m ,k) 

Pn+1 l + PX n (M-X n ) Pn 



l + PX n (M-X n ) 
for all m,k £ {1,2,...,M}. 



(25) 



Since we assumed that R„ is symmetric positive definite 
matrix, hence R„ = R^, hence p n m,k ^ > — pit'" 1 ^, Vfc,m £ 
{1, 2, M}. Therefore, from (25), it is easy to see that we 
will have p^f = Pn k ^\Vk,m £ {1,2,...,M}, or R n+1 
is also a symmetric matrix. 
Moreover, from (25), we also obtain 

1 + MPX n „ P\l T 

l+PX n (M-X n ) 1 l + PX n (M-X n ) anan 

Denote H„ = [ a n a n +i ■ ■ ■ a n+ M-i ]• We see that 
the columns of H„ creates M linearly independent eigen- 
vectors of the matrix R„. Moreover, we also have 



H^ +1 R„ + iH„ + i 



1 + MPXn „ T 



l + PX n {M-X n ) 
PXl 



H n+1 R„H n+ i 



l + PA„(M-X0 H «+ ia " a « H " +1 (26) 

Note that since all columns of H„ are eigenvectors of the 
matrix R„, so all the columns of the matrix H n+ i are also 
eigenvectors of the matrix R„, hence we has the following 
eigenvalue decomposition 



A„ — H„ +1 R„H^ +1 



(27) 



where A„ is a diagonal matrix. 
Moreover, we have 



where 



H^ +1 a„<H n+1 = [<H n+1 ] J <H„ +1 (28) 

a[H„ + i = a? [ a n+ i a n+ 2 ■ ■ ■ ct n+M ] 

= [ • • • M ] (29) 

From (26), (27), and (28), we must have H^ +1 R„ +1 H„ +1 
must be a diagonal matrix since the right side of (26) is a 
diagonal matrix. Hence, all columns of the matrix H n+ i are 
eigenvectors of the matrix R„+i. 

Assuming (Xn \ Xn \ A„ M ^ are M eigenvalues corre- 
sponding to eigenvectors which are columns of the matrix 
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H„. By this notation, we see that A„ = Xn \ Vn € N. 
Combining with (22) with (26), (27), (28), and (29) we 
obtain 



\(*0 _ 

A n+1 — 



(l+MPA< 1 1 ')A( 1 fc+1 > 
(l+PA^M-A^) ' 

l + PA^CM-AL 1 ')' 



fc = 1,2,...,M- 1 



(30) 

for all fc e {1,2,...,M}. 

Since we assumed that all eigenvalues of R„ are positive 
(R„ symmetric positive definite), from (30) we see that all 
eigenvalues of R„+i are also positive. Note that we also 
confirmed that R„+i is symmetric above, therefore R„+i 
is a symmetric positive definite matrix. In short, if R„ is 
a symmetric positive definite matrix and has all columns of 
the Hadamard matrix as its eigenvectors, then R n+ i has all 
these properties. This concludes our proof by induction. 

According to the Lemma 1, [14], the sequence Xn ^ con- 
verges to a fixed point A*, which is the solution in [1, M] of 
the following equation 



(PMX + 1) 



when 



M -! = [PM(M - A) + 1] M 
M ~ x < (PM 2 /4 + l) M 



(31) 



(PM 2 /2 + 1) M - 1 < (PM 2 /A +1) M (32) 
When the condition (32) satisfies, from (22), (23) we obtain 

lim inf 



PX 2 n P(\*) 2 



= lim inf ■ 

n-Kx> PM A„ + 1 

Observe that 1 < A* < M, so < 



PMX* + 1 

P(A*) 2 



PMX* + 1 < L 
Therefore, the constraints in the Theorem II is satisfied. 

Applying the result of this theorem, we have any rate less 

than 



R* m = -]- lim sup log 

^ n,— voo 



l 



px 



= "2 log 



1 



MPX n + 1 

P(A*) 2 1 



MPX* 



1 



is achievable, for all m = 1,2,..., M. Hence, any sum rate 
which is less than 



M 



1 + MPX* 



1 + PX*{M - X*) 




1 + MPX* 
l + PX*(M - X* 



= -log(l + PMA*) 



is achievable, where A* is solution in the [1,M] of the 
equation (31). This result coincides with the formula (68) 
in [14]. The paper [16] proves that this achievable sum rate 
is optimal for the class of linear feedback coding. 



VI. Conclusion 

A posterior matching based encoding-decoding strategy for 
general Gaussian MAC channel with feedback was proposed, 
and achievable rate region, error performance were drawn. 
Finally, we analyzed error performance of the proposed 
posterior encoding scheme and showed that the time-varying 
posterior matching scheme and variable rate decoding ideas 
can be applied to Gaussian MAC channel and obtain optimal 
performances. Specifically, the proposed encoding scheme 
achieves the capacity of two-user feedback Gaussian MAC 
channel as well as linear-feedback sum-rate for symmetric 
Gaussian MAC channel with feedback where the number 
of users is arbitrary. Moreover, by the encoding scheme's 
structure, which uses the spreading codes like the Hadamard 
matrix, our encoding scheme can be directly applied to 
CDMA systems with feedback. Finally, by analyzing all 
arguments in this paper, the time-varying posterior matching 
scheme approach might be applied for other Gaussian and 
non-Gaussian multiuser channels to achieve optimal perfor- 
mances. 



Appendix 
Proof of the Lemma II 

Proof: We use the same line argument as Lemma 1 
[4]. Assume we are given a transmission scheme with M 
transmission functions <j4 m ' and a decoding rule which are 
known to achieve the rate vector (ii*, R*,, R* M ). For 
simplicity, we assume that the decoding rule is fixed rate 
(i.e.,\A^(y n )\ — 2~ nR ™ for all y n ), since any variable 
rate decoding rule can be easily mapped into a fixed rate 
rule that achieves the same rate vector. It is easy to see that 
in order to prove that the above translates into achievability 
for some rate vector (Ri < i?*,i?2 < R* 2 ,---,Rm < R* M ) 
in the standard framework, it is enough to show we can find 

M sequences rl m) = {d^ e (0, 1)}^ J , and such that 

' (m) 

we have the uniform achievability over 1 n , i.e., 

lim max F(6 £ A^(y n )|e ro = 9 m ) = 



We now show how ^ can be constructed for any Rm < ~~- 
R* m . Let p4 m ' (e) be the (average) error probability associated 
with our scheme and the fixed rate vector (J?f , Rt,, R* M ). 
Define 

4 m) - {dm g (o, i) : p(e m i Al m )(r n )|e m = e m ) 



> \M m) (e) 



and write 



p^\e) = / P(9 m i A^)(F")|6 m - m )M n 



> 



m) 



(e) 



) (0 m )d6 r> 
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and so we have that / l A ( m )(9 m )d9 m < ypn(e). It is 
now easy to see that if we want to select such that 

ll m) n At ] = 0, and also 0gj n - 9$> > 2""^, then a 



sufficient condition is that 




2 ™- R ™ for some positive tA — >• 0. This condition can be 
written as 

\ log |lt") | < R* m + i log (l - ^ m) (e) - r™) 

= < n +o(l) 
At the same time, we also have by definition 

lim max P(0 g A^(Y n )\Q m = 6 m ) 

< lim Jp { r?\e) = 0, Vroe{l,2,...,M} 
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